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Abstract 

This study examines the relationship between students' socioeconomic 
characteristics and qualification for a merit scholarship in a new, state-run program. 
The study finds that White, Asian American, and female students, and those in 
wealthier communities, will be awarded a disproportionate number of scholarships, 
and that the scholarship program is unlikely to meet the goal of increasing access to 
higher education in the state. ) 
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High-Stakes Testing and State Financial Aid: Evidence From Michigan 



Introduction 

Financial assistance for individuals attending college has existed in this 
country almost as long as higher education itself. Holtschneider (1997), McPherson 
and Schapiro (1998), and Wick (1997) describe how scholarships were established in a 
number of colleges as early as during the colonial era and in the 19th century. The 
earliest scholarships were often awarded based on the academic merit of individual 
students, with some consideration given to financial need (Hauptman, 1990) 

This practice was carried on into the 20th century largely by the private elite 
colleges and universities in the eastern part of the country. Recognizing the 
inequities of this system, and with no common method for determining financial 
need, many of the elite private institutions banded together in 1954 to establish the 
College Scholarship Service (CSS) as part of the College Entrance Examination 
Board. The CSS developed a formula for institutions to share to help determine the 
financial need of their applicants. With this action, most private institutions shifted 
their awarding of scholarships to a system based on family financial need. 

This emphasis on financial need in determining eligibility for undergraduate 
scholarships was recognized by the federal government with the passage of the 
Higher Education Act of 1965, which implemented the Educational Opportunity 
Grant program (the precursor to Pell Grants). The states followed suit as state- 
funded scholarship funds grew after creation of the State Student Incentive Grant 
(SSIG) program. Created as part of the 1972 reauthorization of the Higher Education 
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Act, the SSIG program provided matching federal funds to states that funded their 
own scholarship programs. The great majority of these state scholarship funds were 
awarded based on financial need. 

Since the 1980s, however, the use of financial need as the basis for awarding 
scholarships by the states has been eroding. Between 1982 and 1999 spending on 
need-based scholarships for undergraduates by the states increased 7.3 percent 
annually, while spending on merit programs increased at a 12.7 percent annual rate. 
The proportion of state grants awarded based on merit has risen from 9.0 percent to 
18.6 percent during this period (Heller, in press). 

There are numerous examples of state merit scholarship programs that have 
been created in recent years. The most well known is the Helping Outstanding 
Pupils Educationally (HOPE) program in Georgia. Begun in 1993, it has grown to 
become the largest state-run merit scholarship program in the country, awarding 
$189 million in the 1998/1999 academic year (Heller, in press). The primary 
academic criteria used for the awarding of HOPE scholarships is the attainment of a 
B average (3.0 on a 4.0 scale) in a selection of high school core curriculum subjects 
(Mumper, 1999). 

Looking to duplicate the popularity of the HOPE program among Georgia 
voters, 1 Governor John Engler of Michigan announced in his 1999 State of the State 
Address that he would introduce legislation to create the Michigan Merit Award, 
"for all Michigan high school graduates who master reading, writing, math and 
science" (Engler, 1999). Engler proposed that the program be funded from a portion 
of the state's share of tobacco settlement funds. The bill quickly passed both houses 
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of the Michigan legislature and the Michigan Merit Award Scholarship Act was 
signed into law by Engler on June 30, 1999. The legislation created the Michigan 
Merit Award Board to implement the program, with the stated goal of the Board "to 
increase access to postsecondary education and reward Michigan high school 
graduates who have demonstrated academic achievement" ("Michigan merit award 
scholarship act," 1999). 

The Act provides scholarships of up to $2,500 for students who score at Level 
1 (exceeds Michigan standards) or Level 2 (meets Michigan standards) on all four 
portions of the Michigan Educational Assessment Program High School Tests 
(MEAP HST). The tests are given in four subject areas: mathematics, reading, 
science, and writing. 2 All students in Michigan, regardless of family income or 
other characteristics, are eligible for the awards. 3 Eleventh graders who took the 
HSTs in the spring of 1999 (before passage of the legislation) are the first cohort of 
students eligible for the scholarships, to be awarded when they enroll in college in 
the fall of 2000 or later. Funding for the program was set by the legislation at 
30 percent of the tobacco settlement total in fiscal year 2000, 50 percent in 2001, and 
75 percent in 2002 and subsequent years. 

Michigan's Merit Award Scholarship, however, differs significantly from 
those of other states. Most other states, like Georgia's HOPE scholarship program, 
use high school grade point average, or. some combination of grade point average 
and other criteria, such as standardized test scores, to determine scholarship 
eligibility. Michigan's is the largest state merit award program to rely on 
standardized instruments as the sole criterion for scholarship eligibility. Thus, the 
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experience in Michigan provides an excellent opportunity to measure the impact of 
high-stakes testing as a criterion in the awarding of financial aid for college. 

This study analyzes the MEAP results of the first cohort of eligible students in 
Michigan to address the following questions: 

1. How did qualification for the Michigan Merit Scholarships differ for 
individuals with different socioeconomic characteristics? 

2. How do these various characteristics jointly relate to scholarship 
qualification? 

3. Is the Michigan Merit Scholarship Program, through its use of high-stakes 
testing, likely to achieve the legislatively-mandated goal of increasing access 
to higher education in the state? 

Literature Review 

There are two primary bodies of literature that are relevant to the questions 
in this article. The first includes those studies that examine the relationship 
between students' socioeconomic characteristics and the results of standardized tests. 
The second body includes the literature on the effectiveness of financial aid in 
promoting access to college for different populations of students. 

Studies of high school students that have looked at student characteristics 
such as race, ethnicity, or socioeconomic status (SES) have consistently found strong 
relationships between those constructs and performance on standardized tests. 
Significant achievement gaps between White and Asian American students on one 
hand, and Hispanic and African American students on the other, or between high 
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SES students and low SES students, have been identified. These gaps persist 
regardless of what specific learning outcome is measured, or whether the analysis is 
conducted at the level of individual students within schools or at the level of the 
schools themselves. 

At the national level, the standard reports come from the National 
Assessment of Educational Progress (NAEP), which has been administered by the 
U.S. Department of Education for students in grades 4, 8, and 12 since 1969. 
Comparing student racial subgroups on the reading component of the 1998 NAEP, 
for example, Donahue, Voekl, Campbell, and Mazzeo (1999) reported that the 
average reading scores for White students was higher than that for African 
American, Hispanic, and Native American students at all grade levels tested. 

Similar results have been found for the other components of the test, including 
mathematics, science, and writing (Greenwald, Persky, Campbell, and Mazzeo, 1999; 
O'Sullivan, Reese, and Mazzeo, 1997; Reese, Miller, Mazzeo, and Dossey, 1997). A 
number of researchers have synthesized data from various Education Department 
reports to draw further conclusions. Lee (1998) for example, organized achievement 
gaps from the NAEP mathematics test into four dimensions, pairing the within- 
and between-school levels with each of the categories of race and SES. His results, 
focusing on state policy correlates of gaps from the 1992 NAEP, indicate that while 
the existence of the gaps is universal, their size and the significance of the 
independent variables varies among different states. Sedlacek (1995) used 
hierarchical linear modeling to simultaneously weigh both within-and between- 
school effects, finding similar racial linkages to achievement across subject areas. 
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and when controlling for gender, SES, and course-taking patterns. Bruschi and 
Anderson (1994), looking specifically at science achievement on the 1990 NAEP, also 
confirmed large differences between White, Hispanic, and African American groups 
across science content areas. 

The linkages between academic achievement and SES have been less well 
documented, largely because SES is more difficult to measure than race. One 
measure of poverty, student eligibility for free or reduced lunches through the 
National School Lunch Program, has been collected as part of the NAEP dataset only 
since 1996. Donahue et al. (1999) found that students who were eligible for the free 
and reduced-price lunch program had lower average reading scores than students 
who were not eligible for the program, at all grade levels tested. Of course, race and 
SES are highly correlated, both within and among schools (Orfield, 1994), urging 
caution on researchers who attempt to deal with both constructs. Stevens and 
Grymes (1993) emphasizes that student subgroup achievement differences cannot be 
attributed to the subgroup identification itself, but rather that a complex array of 
factors such as opportunities to learn and socio-cultural environment combine to 
affect students' academic performance. One study that has attempted to parse the 
separate effects of race and SES is Hedges and NowelTs (1999) meta-analysis of seven 
previous studies (all of which used nationally-representative samples of high school 
students from 1965 to 1996). This study found that about a third of the African 
American- White racial gap in test scores is attributable to SES differences between 
the races. They also show that, while the gap is smaller at the bottom 5 percent and 
10 percent of the test-score distribution (indicated by over- representation of African 
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Americans), the top of the distribution shows a much larger gap: a hugely 
disproportionate under-representation of African Americans relative to Whites. 
Unlike economic status at the student level, however, school-level resources have 
generally not been found to correlate with student performance (Gaudet, 1994; 
Sedlacek, 1995). 

Results for gender subgroups, by contrast, are somewhat mixed depending on 
subject area and grade level. Donahue et al. (1999) found that girls had higher 
reading scores than boys at all grade levels. Bruschi and Anderson (1994) found that 
17 year-old girls' achievement lagged that of boys in physical sciences and earth and 
space sciences, but surpassed that of boys in the life sciences and the nature of science 
(a content area that includes processes, principles, and knowledge of scientific 
method). Sedlacek (1995) reported that 12 th grade boys had higher achievement than 
their female peers in mathematics. 

There is a long and rich history of research studies that have examined the 
effectiveness of financial aid on influencing the decisions that potential students 
make about enrolling in college. This research is often referred to as "student price 
responsiveness," "student demand," or "student price elasticity" studies. Reviews 
of much of this research have been published over the last three decades by (Heller, 
1997; Jackson and Weathersby, 1975; Leslie and Brinkman, 1988). 

While these studies have utilized a broad range of research methodologies, 
have used different samples of students, and have been conducted at different times, 
there are two conclusions that have generally been reached by researchers. First, 
different types of financial aid awards have varying impacts on college enrollment 
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behavior. In general, grants tend to have a stronger influence on college enrollment 
than do student loans or work study awards of the same magnitude. 

Second, students with varying characteristics have differing enrollment 
reactions to changes in the amount of financial aid offered. In general, African 
American, Hispanic, and low income students tend to be more price responsive (i.e., 
are more likely to enroll in college, or change the type of institution in which they 
enroll) than are White and middle- and upper-income students. 

A couple of examples illustrate these effects. St. John (1990) analyzed the 
High School and Beyond sophomore cohort to examine the effects of tuition and 
financial aid increases on the college enrollment decisions of graduating high school 
students. He found that for low-income students, their enrollment response to a 
$100 increase in grant aid was over twice the response to a $100 decrease in the 
tuition price. In addition, the enrollment response of these students was over twice 
as large as the grant and tuition sensitivity of higher-income students. Heller 
(1999a) examined the public higher education enrollment response of different 
racial groups to increases in state grant spending. He found that the enrollment 
response of African Americans to increased state grant spending was approximately 
3.7 times as large as White students, and that of Hispanics was 2.8 times as large as 
Whites. 

Methodology 

The data used in this study are from three sources. In the fall of 1999, the 
Michigan Department of Education released a datafile with the spring Michigan 



High-Stakes Testing and State Financial Aid: Evidence From Michigan 



Page 9 



Educational Assessment Program (MEAP) High School Test (HST) results (National 
Computer Systems, 1999). The datafile contains information about each student, 
including racial/ethnic background, gender, school attended, and test results. These 
data are used by the Michigan Merit Award Board to determine scholarship 
eligibility. The file includes data on 124,350 students who took the HST tests in the 
Spring of 1999. The MEAP data set includes raw and scaled test scores for each of the 
four subtests (reading, writing, mathematics and science). It also records the coded 
performance level, based on established cutoff points from the scaled scores, to 
indicate whether the student has "met" or "exceeded" the Michigan achievement 
standard for each subject area. Each student's self-reported racial category and 
gender is also recorded. 

The second data source is the school-level data from the 1999 Michigan 
School Report (MSR), which includes 704 of the high schools represented by the 
students in the MEAP dataset (Michigan Department of Education, 1999b). The MSR 
data set provides the percentage of students in each school who qualified for free or 
reduced-price lunch under the National School Lunch Program (NSLP) as of 
December, 1998 (herein designated as "free lunch"). Since eligibility for NSLP is 
determined by a federal formula of family size and income, this percentage is an 
indicator of the income levels of families in the school's district. A final dataset, the 
Michigan DOE's Building Enrollments file for Fall 1998, provides the overall racial 
and gender makeup for each school (Michigan Department of Education, 1999a). 

The first research question is answered using bivariate data analysis 
techniques. We compare the percentage of students who qualified for the 
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scholarship from each demographic category with the percentage of students who 
took all four of the subject area tests in that category. The distribution of students 
with different background characteristics among scholarship qualifiers indicates 
which students in the state are benefiting most from the scholarship program. 

Over- or under-representation of scholarship qualifiers relative to test-takers 
indicates an imbalance in the awarding of scholarships. 

The second portion of the analysis uses multiple regression techniques to 
assess the joint relationships of the student and school characteristics to scholarship 
qualification. Since we are interested primarily in the likelihood of a student with 
given characteristics qualifying for a scholarship, we limited this analysis to only 
those students who actually completed all four of the required subject tests. We 
further reduced the dataset to those students whose schools reported free lunch data 
and those students who self-reported their race and gender. 

Most previous studies have relied on ordinary least squares regression or 
hierarchical linear modeling (HLM) to correlate an interval-scaled outcome variable 
- standardized test scores - with the various student background predictors. The 
present study takes a different approach, however, by considering the effect of the 
predictors on a dichotomous outcome (qualifying or not qualifying for a 
scholarship) that results from a more-or-less arbitrary cutoff point in the scaled test 
scores. For this analysis we use logistic regression techniques. Logistic regression is 
an appropriate multivariate technique for this analysis because of the dichotomous 
distribution of the outcome variable in the study (Cabrera, 1994; Kleinbaum, 

Kupper, and Muller, 1988). 
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As other researchers have pointed out, the African American-White gap in 
achievement test scores is largest near the top of the distribution (Hedges and 
Nowell, 1999). If the same holds true for the MEAP tests, then since the break-point 
for the Michigan Merit Award Scholarships is near the top of the achievement scale, 
the racial gap in the program's outcomes should be larger than overall averages of 
scaled scores would suggest. Logistic regression, by correctly modeling this high 
break-point for a dichotomous outcome, will more accurately reflect the resulting 
racial gap in the awarding of scholarships than would an OLS or HLM technique 
that looks only at the scaled test scores. 

As in ordinary least squares, standard logistic regression assumes that the 
observations in the sample are independent of one another. The data in this study 
do not meet this restriction, however, because the school-level free lunch data are 
not independent for students within each school. To account for this, the logistic 
regression models were fit using Huber /White estimators of variance, which allow 
observations that are not independent from one another (Huber, 1967; White, 1980, 
1982). These "relaxed" standard errors allow for the correlated observations of free 
lunch percentage within schools. 

The general model fit in this study is: 

p( y. e*p(ft> +M + M + M + ft W) 

y ‘ i + exp (ft, + A *;+&«,+ AA + AW) 

where 

P(Y,) = Probability of student i qualifying for a scholarship 

F, = Percent free lunch students in school attended by student i 

R, = Vector of dummy variables for race of student i (White omitted) 
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S, = Sex of student i (female omitted) 

F,R, = Vector interacting race dummy variables with school free lunch 
percentage 



The model in Equation 1 was fit by sequentially entering variables in blocks, with 
the first block being the school-level variable, the second block the individual 
characteristics, and the third block school and individual characteristics jointly. A 
fourth model was fit which added the interaction between race and the free 
lunch percentage in the school, in order to test whether the effect of race on the 
outcome differed for students in wealthier versus poorer districts. 

The effect of each predictor on the outcome is expressed as a Delta-p statistic, 
recommended by Petersen (1985) as a method for expressing the relationship 
between a unit change in a predictor and the estimated percentage change in the 
outcome. 4 The Delta-p statistic is calculated as: 



where 



Delta-p = “■W ex PW 

l + exp(L,) l + expfZfl) 



f 

= Ln 

\ 







( 2 ) 



( 2 . 1 ) 

( 2 . 2 ) 



For example, a Delta-p value of 0.025 indicates that a one unit change in the 
predictor is related to a 2.5 percentage point increase in the likelihood that a student 
would receive a Michigan Merit Award Scholarship. 
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In addition to the Delta-p measure, additional statistics shown for each model 
are: 1) the outcome mean for the observations included in the model; 2) the number 
of observations included in the model; 3) the percentage of cases properly classified 

as either receiving or not receiving a grant (using a 0.5 cutpoint); and 4) a % 2 test of 
the model fit. Also shown is a pseudo R 2 statistic, calculated as: 



Pseudo 



R 2 =1- 



Model log likelihood 
^Intercept - only log likelihood ; 



(3) 



The pseudo R 2 statistic shown in Equation 3 represents the proportion of the error 
variance reduced by a particular model in comparison to one that includes an 
intercept only. 



Results 

Bivariate Results 

In the 1999 HST tests, 124,350 Michigan students took at least one of the four 
subtests, and 53 percent (66,419) of these took all four subtests. Table 1 presents the 
test results for students of different racial/ethnic backgrounds and genders. 

[Table 1 here] 

Michigan is primarily a biracial state; almost 90 percent of the students taking 
at least one of the HST tests in 1999 were White or African American (for students 
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with a valid race /ethnicity in the test file). 5 While Whites represented 70 percent of 
all students taking at least one test (column G in Table 1), they made up almost 
88 percent (column H) of all scholarship qualifiers. African American students were 
the most under-represented; while 19 percent of all test takers were African 
American, they qualified for only 3.1 percent of the scholarships. These results are 
not surprising given the evidence of the relationship between race/ethnicity and 
standardized test scores that was described earlier. Female students, who were just 
over half of all students taking at least one of the HST subtests, represented 
56 percent of all scholarship qualifiers. An ANOVA analysis of the scholarship 
qualification rates among the racial/ ethnic groups and between the genders 
determined that the differences were statistically significant different from zero at a 
level of p<.001. 

The difference between the racial distributions of students who took the test 
and those who qualified for a Michigan Merit Award Scholarship can be seen in 
Figure 1. White and Asian/Pacific Islander students were clearly over-represented 
among scholarship qualifiers, while students from the other groups were under- 
represented. 

[Figure 1 here] 

Table 2 shows the distribution by the percentage of students qualifying for free 
lunch in each student's school. The approximately 700 secondary schools in 
Michigan were divided into quintiles, with the first quintile representing the 
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schools with the highest percentage of students on free lunch. As can be seen there 
is a strong inverse relationship between the income level of the students in a school 
(as measured by the free lunch percentages) and the qualification for the 
scholarships: the lower the percentage of students on free lunch, the greater is 
the percentage of students qualifying for scholarships. Figure 2 illustrates this 
relationship graphically. An ANOVA analysis of the scholarship qualification rates 
among the free lunch quintiles determined that the differences were statistically 
significant at a level of p<.001. It is interesting to note that, by combining the two 
lowest free lunch quintiles in Table 2, we find that more than half of the 
scholarships (53.9%) are being awarded to students who attend schools in which 
fewer than 10 percent of the student body qualifies for the free lunch program. 



[Table 2 here] 
[Figure 2 here] 



Multivariate Results 

Table 3 presents the results of fitting the logistic regression models. The first 
model fitted includes the school free lunch percentages alone; it indicates that a 10 
point increase in the percentage of students on free lunch at a school corresponds to 
a 7 point decrease in the probability that a student in the school will earn a 
scholarship. The model correctly predicts the outcome of 69.2 percent of the cases, 
approximately the same percentage of all of the models fitted. 
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[Table 3 here] 

The second model examines the effects of the individual characteristics on 
the probability of receiving a scholarship. Note that the omitted category for race is 
White students, and for gender, female students. Asian Americans are the only 
racial group who are predicted to have a higher probability (by 5.6 percentage points) 
of earning a scholarship than are White students. The other groups are all predicted 
to have a lower probability than Whites, ranging from African Americans (23.9 
points below) to multiracial students (7.5 points below). Male students are predicted 
to qualify for a scholarship at a rate 4.8 percentage points below females. 

The third model includes both school and individual level characteristics. 
Although including these variables jointly tends to mitigate the effects of each 
shown in the first two models (i.e., all the Delta-p statistics, with the exception of 
that for gender, diminish in absolute value), the effects are still in the same 
direction. Once again, attending a school with a higher percentage of students on 
free lunch is related to a reduced probability of qualifying for a scholarship, after 
controlling for the individual characteristics included in the model. Asian 
Americans and females are still predicted to have a higher qualification rate than 
Whites and males. The gap between the White qualification rate and that of the 
other racial groups ranges from almost 20 points for African American students to 
4.2 points for multiracial students. 

The last model builds on the previous one by including the interaction 
terms. 6 The effects of race and gender are largely the same as in the previous model. 
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though the magnitude of each is slightly different (the effect of being in the 
multiracial category is no longer significantly different from zero). Only two of the 
interactions are found to be significant predictors of the probability of earning a 
scholarship. The effect of being in a poorer school (those with higher percentages of 
free lunch students) on the probability of qualifying for a scholarship is greater for 
Asian Americans and Hispanics than for students of other races. Every 10 point 
increase in the percentage of students on free lunch in the school is related to an 
additional seven point decrease in the scholarship qualification rate for Asian 
Americans and a three point drop for Hispanics, beyond the overall effect of the 
poverty status of the school on all students. 

Discussion 

The results presented here demonstrate that there are important differences 
in the rate at which students qualify for the Michigan Merit Award Scholarships, 
and that these differences are correlated with both school and student 
socioeconomic characteristics. These effects can best be demonstrated by examining 
them visually. Figure 3 illustrates the predicted probability of qualifying for a 
scholarship at varying levels of school free lunch percentage, for males of different 
racial backgrounds. 

[Figure 3 here] 
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The inverse relationship between the free lunch percentage of students in the 
school, and the probability that a student in that school would qualify for a 
scholarship, can be clearly seen. As the proportion of students on free lunch 
increases, the predicted probability of qualifying for a scholarship decreases for all 
students. For Asian American and Hispanic students, the rate of decrease is greater 
due to the interaction effect described in the previous section. At school free 
lunch percentage levels exceeding approximately 20%, Asian American students are 
no longer predicted to have a scholarship qualification rate exceeding that of 
Whites. Students in the poorest schools - those with the most free lunch recipients 
and the most financial need - have a predicted probability of qualifying for a 
scholarship that approaches zero, a result also borne out by the bivariate analysis 
(Table 2). 

Figure 4 presents the same information for female students. Again, the 
relationship between school poverty level and the probability of scholarship 
qualification is clear. The gender effect can be seen by comparing the curve for each 
racial group with its corresponding curve in Figure 3. For every group, and at every 
school poverty level, females have a higher predicted scholarship qualification rate. 

The analysis to this point has answered the first two research questions of this 
study. There is a clear relationship between race, gender, school poverty level, and 
the probability of qualifying for a Michigan Merit Award Scholarship. The findings 
are consistent with the prior research on standardized tests and the socioeconomic 
characteristics of the students taking them. 
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The question left unanswered so far is the third research question: Is the 
Michigan Merit Scholarship Program likely to achieve the goal of increasing access 
to higher education in the state? Since the first cohort of students eligible for the 
scholarships is just now enrolling in college, the answer cannot yet be determined 
with absolute certainty. However, the findings of this study do allow us to 
prospectively answer the question as can best be determined with the evidence 
available. 

The body of research that has examined the relationship between students' 
socioeconomic characteristics and postsecondary educational attainment is very 
clear. 7 African American and Hispanic students, and students of all races from poor 
families, enroll in and graduate from college at lower rates than do wealthier 
students and White and Asian American students. These findings are generally 
consistent across different institutional sectors, over time, and in different regions of 
the country. 

While there is limited evidence on educational participation and attainment 
rates in individual states, there is some to indicate that the patterns in Michigan 
mirror at least in part the broader national trends. Analyses of data from the 
Current Population Survey, conducted by the U.S. Bureau of the Census, indicate 
that there is a gap in the college completion rates of White, African American, and 
Hispanics in Michigan (Day and Curry, 1998). While 22.8 percent of Whites had 
completed a bachelor's degree or more in 1998, only 11.6 percent of African 
Americans and 7.7 percent of Hispanics had attained the same level of 
postsecondary education. 8 
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In conjunction with a published study examining the college participation 
rates of students from different racial/ ethnic groups, Heller (1999b) calculated the 
college participation rates of these groups in each state using enrollment data from 
the Integrated Postsecondary Education Data System, and population data from the 
U.S. Census Bureau. He found that in Michigan, the undergraduate college 
participation rates of Whites was 50 percent higher and Asian Americans 
100 percent greater than that of both African Americans and Hispanics (personal 
communication). These differences in college participation rates mirrored the 
national trends. 

Mortenson (1999) examined the college participation rates of students 18 to 24 
years old in four income quartiles nationally. In 1997, students in the top quartile 
(family income above $74,583) had a college participation rate of 88.8 percent, i.e., 

88.8 percent of all 18 to 24 year-olds in this group had attended at least one year of 
college. For students in the lowest quartile (income below $25,064), the participation 
rate was 53.2 percent. Mortenson found similar gaps in the college completion rates 
by income quartile. 

If the Michigan Merit Scholarship Program is to achieve its stated goal of 
increasing college access in the state, it would have to focus the awards on those 
students whose college enrollment decisions would most be influenced by the 
awarding of grant aid. Our findings, however, demonstrate that the scholarships 
will be awarded disproportionately to. those students who are most likely to be 
attending college anyway, even without the grant assistance, based on the 
conclusions in the college access literature - Whites, Asian Americans, and students 
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in wealthier school districts. There may be a slight effect on college access, as there is 
a very small number of students who qualified for scholarships who fall into the 
college access "at risk" categories . 9 However, the data show that the vast majority of 
the awards will go to students who, based on the existing evidence, would be 
predicted to attend college even without the scholarship. 

Given the current structure of the Michigan Merit Scholarship Program and 
the results from the first cohort of eligible students, there is little evidence to 
support the view that the program will help to improve college access in Michigan. 
The state could more effectively improve college access by distributing the funds to 
those students who are least likely to attend college without such assistance. 




23 



High-Stakes Testing and State Financial Aid: Evidence From Michigan Page 22 



CD 

C 

a> 

U 

"d 

§ 

Oh 

d 

0 

*H 

u 

1 

w 

13 

u 

<5 

04 

42 

3 

CD 

« 

04 

H 

co 

X 

l— 1 rn 

W 5 
►-J ^ 
pa 

< 85 



o 



w 



w 



& 



c.S § 

<11 !T — * 



o , 
a S3 

I 



T3 

V 

§ o 

« • 

Oh 

03 

lH 



<X r/\ 
**H « 

r. »h 

« w 


v® 

o'* 


v® 

o'* 


v® 

o'* 


V® 

0 s 


v® 

0 s 


V® 

0 s 


v® 

0 s 


v® 

o'* 


v® 

0 s 


»h cd 


tv 


ON 


rH 


IN 


00 


IN 


rH 


CN 


00 


JS id 


o 


CN 


CO 


rH 


IN 


rH 


CN 1 


NO 


co 


o 

^ d 
u cr 










00 




1 


in 





<U 

u 

flj 

P* 



Th 00 

o o 



H ON VO to N 

no d tv o d 



CN 



>sP v® V® V® V® 

0 s 0 s 0 s 
CN NO CN O 00 

ON CN O CN CN 

rH tv 



V® 

Tt; 

ON 



v® 

0 s * 

O 



v® 

IN 

ON 

CO 



v® V® V® *N® V® sP 

O'' 

o co Ov tv oo co 

in d co lo co cn 

M CO M N CO 



^ v® v® v® 
^ 0 s 0 s ^ 

‘ N ^ so 



CN 



CO CO ON 
CN rH rH CO 



co 



3 S 

1— I 



o'" cy" 

O rH 

IN CN 

LD NO 



00 ON O 00 
CO rH ^ 
^ (N N (N 
CN 



NO ON 

8 58 



O 



v® 

LO 

ID 



■sP "V® >sP V® 

0 s 0 s 0 s 0 s 

in h ^ n 

^ n sb n 

no m lo 



IN 


00 


00 


in 


00 


$ 


00 


ON 


CO 


NO 


00 


tv 


in 


00 


CO 


in 


<3 


CO 


rH 




ON 


cn in 




rH 


NO V 


rH 


tv 




rH tV 



CO 



2 

ON tN 



NO 


rH 


rH 


rH 


CO 


tv 


o 


CN 


00 


rH 


CN 


oo 


On 


00 


ON 


$ 


00 


o 


ON 


rH 


o 


NO 


CN 


in 


00 


o 


in 


CN 


oo v 


rH 


CN 


rH 


rH 


cT 


CN 


rH 




in 








NO 


NO 






o o 

NO NO 



CN 00 



O 

in 



ON 



v® 

5 s 0 s 

NO ON 

CN IN 
CO CN 



in t* 

00 Tji H 



ON O ON 
O O CN 

co oo 



00 



v® v® 
^ ^ ^ 

in on no 

NO rH IT) 

in in 



’'f CO CN 

CO IN rH 

IN li^ rH 



3 



CO 




o 

o 



o 

d 

o 



V® 

0 s 

co 

d 

co 



CN 

NO 



00 

CO 



8 



V® 

Th 

CO 

in 



ON 

rH 

T* 

NO* 

NO 



O 

in 

co 

CN 



O 

H 



ITS 

CM 



CM 



O 

ERIC 



a 

<v 

to 

Ph 



C 

60 

X 

u 



g 

0 

Vh 

Ph 

0> 

U 

C 

QJ 

"d 

• w 

> 

w 

*d 

• fH 

< 

^c3 

■ 

U 

6 

ccS 

■S 

pp 

cu 

-M 

<C 

-M 

CD 

T3 

d 

<c 

60 

.a 

4—* 

CD 

0> 

H 

cn 

a> 

PC 

<s 

-M 

cn 

1 

X 

60 



JLj 

3 

-g 

d 

a 

u 



QJ 

CU 

Vh 

pp 

O 

o 

X 

u 

CD 

X) 

cn 

H-J 

3 

Pfi5 

H 

CD 

.53 

Ph 
CN ^ 

SS 

eo £ 
V O' 

H rH 



O 



u 



pa 



Sc «3 v - 

■ i 



4i C C 

c c 3 <u 

S ■§ ^ « 
5 a S 
* I 



<L» 

_ O 

t/5 KH 

22 K 



Dh 

^ -H « 

55 JC *rj 

tfl c/5 . Jj 

^ '-M 

o J2 ^3 
- o 

55x3 

u <T 

C/5 

6 « 

g is 

'H § S 

*2 

o" yj 



a 

«s 



; £ 



■6 

§ 



QJ o 

3 ^ 
‘5b g> 
a .5 

<u ^ 



£’ 



v© 

O'" 



CP 

•H 

,43 ^ 
2 CQ 
cs \ 

O Q 
45 w 
u 



~L c/5 

CT 



O Dh 

3 ^ 2 

d P >H 
^ ■§, « 
° 3 ° 

3 *u 

a" w 



to 

.5 



s 

ex' 



45 

C/5 

H VH 

O 

•M ^ 

o 

45 

u 

C/5 



Kft (0 

00 -*-» 

rj c/5 y-s 

3 a < 
3 * ^ 
s? a 



OQ 



00 

■§ * a 

D< ^ c/5 

tO Q) 

-*-* (0 +-* 



_ j3 

CO VM P 

t* o ^ 

h * 5 



0/ 

3 

.5 



•6 

§ 



O 

O 



y-^v 














in 


00 


NO 


ON 


tv 






CN 


CO 


CN 


in 


tv 


i 




T— ( 










i 




V© 

0^ 


sO 

0^ 


v0 

O' 1 ' 


vO 

0 s 


sP 

0 s 




sO 


CD 


CN 


NO 


O 


ON 




O 


tv 


NO 


CN 


NO 


tv 


i 


d 




rH 


CN 


CN 


CN 


i 


o 

rH 


v© 

0^ 


v5 


0^ 


vO 

0^ 


sP 

0^ 






oq 


O 


ON 


O 


CN 




o 


ON 


o 


ON 


o 


o 


I 


Q 


i — 1 


CN 


rH 


CN 


CN 


1 


o 














rH 


O 


V© 

0 s 


V© 

0^ 


* 


V© 


V© 


vP 


NO 


ON 


NO 


in 


rH 


00 


co 


in 


CO 


o 


NO 


CO 


CO 


d 


tH 


(N 


CO 


CO 




rH 


co 


v$ 

O'" 


v9 

0^ 


v9 

0^ 


0^ 


0^ 


vP 

0^ 


vO 

0^ 


CN 


in 


ON 


NO 


rH 


rH 


CN 


NO 


cO 


00 


rH 


co 


in 


NO 




rH 


rH 


CN 


CN 


rH 


ON 


rH 


CO 


NO 


o 


ON 


00 


LO 


rH 


00 


LO 


m 


tv 


CO 




CN 


Tf 


rH 


in 


CN 


rH 


rH 


CO 




in 


m 




CD 














CN 










$2 






NO 


in 


tv 


CO 


in 


rH 




ON 


NO 


t-H 


o^ 


CO 


tv 


CO 


CO 


m 


NO 


in 


in 


co 


in 


rH 


CO 


rH 


tv 


NO 


rH 


ON 


CO 


CO 


CO 


CO 


NO 


CN 


rH 


CO 




NO 


rH 


00 


CO 




On 


ccT 






CN 


CN 


NO 




rH 


rH 


rH 


rH 




NO 


rH 


NO 


NO 


rH 


tv 


ON 


o 


in 


5° 


rH 


CN 


CN 




m 


“i 


t% 


tv 


°°v 


CO 


CO 


CO 


CO 


CO 


co v 


Tf 


in 




CN 


CN 


CN 


CN 


CN 


CN 














rH 
















sO 

0^ 


sO 

0^ 


sO 


nP 

0 s 


nP 

0 s " 






00 


m 


O 


rH 


in 






o 


CO 


CO 


tv 


CN 






in 


(N 


rH 


v 








vO" 

0^ 


sP 

0^ 


nP 

O'" 


nP 

0^ 

m 


N. 






o 


in 


ON 


NO 








O 


NO 


ON 


ON 










rH 


NO 










i 


CO 


rH 


1 


1 








1 


1 


v$ 


nP 

0^ 






m 

00 




v$ 


CO 

in 


00 

CN 






rH 

CO 


rH 

o 


m 

00 




o. 






K 


ON 






to 






rH 


■ * 










' — ^ 








.s 














05 




H-» 

C/5 




3 


3 


3 


£ 


«*-» 

o 


rH 


cN 


CO 




m 


4 


H 



O 

ERIC 



c\j 



CO 

c\j 



05 

C\1 



CM 

<D 



60 



PL. 



Ctf 

60 

u 



s 

0 

Ph 

a> 

u 

G 

0> 

W 

• ^ 
< 

13 
• ^ 
u 
C 
cs 
G 

PL, 

o> 

• 4 — > 

Ctf 

• 4 — > 

(X) 

T3 

G 

ctf 

60 

C 

• H 
4-* 
CA 

o> 

H 

w 

o> 

4-> 

LD 

1 

X 

60 

£ 



w 

a> 

13 

> 

JS 

'aJ 

Q 



3 

a> 

G 

o 

• »— i 

co 

CO 

a> 

fib 

a> 

CO ^ 
W £ 

hJ CO 

5 *60 
< O 
H hJ 



■S 

(3 



to 

.s 

'> 

'3 

u 

<u 

« 



3> 

* 

a 

•9 

■8 

£ 



Q) 

6 

o 

U 









1J 

o 

m u 

2 CO 



CO 



05 

. G 
o 



•8 g 

o S 
o > 



3r 



ns 

3 

tj 

’> 

a 



U 

£ u 
5 CO 



ns 

H 

ns 

> 



rH Tt 

Tf VO 



★ ★ 
O CM 
tX LT) 
O O 



o o o o o o o 



o 

o 



u U ft 

« u 2 

i ji 

«i ^ G 



a; 

B a 

ns ’c/5 



* 



* * 

M< 00 
in on on 
O r-4 O 

d o 



(N fN tN 

^ oo in 
o o o 



I 



I 



CM V0 ov T* 
co in co cm 



.s 

u 



G 
ns 

.y Oh 

c « 



g < 53 a 



o o 



S O 



o o o o 



<D 

U 

nS 

u 



<v 

13 

s 



★ 

tx 

o 

o 



o o 



CO CO 

o o o 
o q o 
odd 



0> <u 

0 OJ 

IH »H 




CM 00 rH o 
O O NO 0 s 
‘ rH O ON 

N O ON 
Tf V0 



CO 

d 



no ^ in x o 

ON O f ^ 

CM 00 O 



00 

M 1 



00 00 
O ON 
CO CO 



° 8 



3 



On 

VO 



O 

On 

CM 

in 



00 

o 


O 

vO 




★ 

vO 


rH 


o 


00 


On 


tC 


d 


ON 


CO 






vO 


rH 

in 



ON 

ON 

ON 

rH 



CM V 0 



bs 

O 

CM 




ERjt 



CO 

CM 



TOO *** 10 ** SO 



High-Stakes Testing and State Financial Aid: Evidence From Michigan Page 25 



rH 

CO 




nj 

O ' 1 

I" 

a 

"o 

s 



I 



o 

ERIC 



FIGURE 1: Distribution of students taking at least one test and scholarship qualifiers - by racial/ethnic group 
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FIGURE 4: Predicted probability of qualifying for a scholarship - females 
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Notes 



1 The proposal for the HOPE program was introduced during the first 
gubernatorial campaign in 1990 of former Governor Zell Miller of Georgia, and 
was widely seen as being a key factor in his victory (Mumper, 1999). 

2 The law provides alternative methods for earning a scholarship, including 
scoring above certain levels on ACT or SAT standardized tests, but it is expected 
that most students will attempt to qualify for the scholarships by taking the 
MEAP tests. 

3 The full $2,500 scholarship is awarded for students attending college or some 
other form of postsecondary training in Michigan. Students attending out-of- 
state institutions are eligible for a $1,000 award. In addition to these awards, 
students achieving certain scores on the 7 th and 8 th grade MEAP tests are eligible 
for up to an additional $500 in scholarship funding. 

4 The logistic regression coefficients and Huber/White standard errors for each 
model are available from the authors. 

5 Students self-reported their race /ethnicity on the MEAP tests. There is no way to 
discern the race or ethnicity of the students marked as "missing" in the HST file. 
However, the distribution of the groups in the HST file can be compared to the 
distribution of all 11 th graders as reported by the Michigan Department of 
Education (Michigan Department of Education, 1999a): 
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Group 


% in HST file 


% all 11 th traders 


Native American 


1.1% 


1.1% 


Asian/Pacific Islander 


2.1% 


1.7% 


African American 


19.2% 


13.7% 


Hispanic 


2.6% 


2.2% 


White 


70.2% 


81.4% 


Multiracial or other 


4.8% 






The primary differences between the two categorizations is that African 
Americans are over-represented and Whites under-represented in the HST file. 

6 The interactions of race and gender, and gender and free lunch percentage, were 
also tested, but none were found to be significantly different from zero. 

7 See for example Heller (1999b), Koretz (1990), McPherson and Schapiro (1991, 
1998), and Mortenson (1999). 

8 These figures are for all residents age 25 years old and over in the state. The 
Current Population Survey does not contain a large enough sample to calculate 
(with sufficiently small standard errors) educational attainment rates for 
racial/ethnic and age group subpopulations in each state. However, the national 
figures do show large gaps in the attainment (and college enrollment) rates for 
these groups and across different age cohorts. There is no evidence to indicate 
that Michigan's pattern is substantially different from the national trends. 

9 Of the 20,138 students who qualified for a scholarship by passing all four MEAP 
HST tests in the Spring 1999 battery, 687 (3.4 percent) were African American or 
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Hispanic (Table 1). Only 7.3 percent of the scholarship qualifiers were from 
schools in the lowest free or reduced lunch quintile (Table 2). 
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